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AMENDMENTS TO THE CLAIMS 

Cancel Claim 3 without prejudice. Please accept amended Claims 1, 14, and 20 as follows. 
Listing of claims: 

1. (Currently Amended) A method for real-time obstacle detection from a vehicle moving 
relative to a road, comprising: 

calibrating an image capturing device, such that any image point can be mapped to a real- 
world point; 

receiving one or more images from the image capturing device; 

receiving information about the ego-motion of the image capturing device; 

selecting one or more real-world points according to a tractability criterion inversely 
proportional with an uncertainty associated with localization of the real-world points : 

applying a motion estimation method on the one or more real-world points, the one or 
more images, and the known plane to determine an image motion flow of the one or more real- 
world points; 

determining a true motion flow of the one or more real-world points based on the one or 
more real world points, the one or more images, and the ego-motion; and 

determining that the one or more real-world points is one or more obstacle points by 
comparing the image motion flow and the true motion flow. 

2. (Original) The method of claim 1, wherein applying a motion estimation technique 
comprises applying an optical flow method with statistical fusion. 
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3. (Canceled) 

4. (Original) The method of claim 1 , wherein receiving information about the ego-motion 
of the image capturing device comprises receiving information from one or more sensors 
onboard the vehicle, 

5. (Original) The method of claim 2, wherein receiving information from the one or 
more sensors comprises receiving information from at least one of a gyro and a GPS. 

6. (Original) The method of claim 1, wherein receiving information about the ego- 
motion of the image capturing device comprises determining the information based on the one or 
more images. 

7. (Original) The method of claim I, wherein determining that the one or more real-world 
point is one or more obstacle points by comparing the image motion flow and the true motion 
flow comprises: 

if the image motion flow does not match the true motion flow, determining that the one 
or more real-world points are one or more obstacle points; and 

if the image motion flow matches the true motion flow, determining that the one or more 
real-world points are not obstacle points. 

8. (Original) The method of claim 1, further comprising: 

tracking data of a plurality of instances of the one or more obstacle points over a time 
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interval; and 

determining that the one or more obstacle points is one or more actual obstacles based on 
the data, 

9. (Original) The method of claim 8, wherein determining that the one or more obstacle 
points is one or more actual obstacles based on the data comprises determining that the one or 
more obstacle points is one or more actual obstacles based on the data and information based on 
other detection methods. 

10. (Original) The method of claim 9, wherein determining that the one or more obstacle 
points is one or more actual obstacles based on the data and information based on other detection 
methods comprises determining that the one or more obstacle points is one or more actual 
obstacles based on the data and information based on at least one of radar obstacle detection, 
iidar obstacle detection, and ultrasonic obstacle detection. 

11. (Original) The method of claim 8, further comprising classifying a type of the one or 
more actual obstacles using automated detection. 

12. (Original) The method of claim 8, further comprising classifying a type of the one or 
more actual obstacles using a graphical user interface. 

13. (Original) The method of claim 1, wherein calibrating the image capturing device 
comprises calibrating a video camera. 
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14. (Currently Amended) A system for real-time obstacle detection from a vehicle 
moving relative to a road, comprising: 

an image capturing device; 

means for calibrating an image capturing device, such that any image point can be 
mapped to a real-world point; 

means for receiving one or more images from the image capturing device; 

means for receiving information about the ego-motion of the image capturing device; 

means for selecting one or more real-world points according to a tractability criterion 
inversely proportional with an uncertainty associated with localization of the real-world points : 

means for applying a motion estimation method on the one or more real- world points, the 
one or more images, and the road to determine an image motion flow of the one or more real- 
world points; 

means for determining a true motion flow of the one or more real-world points based on 
the one or more real world points, the one or more images, and the ego-motion; and 

means for determining that the one or more real-world points is one or more obstacle 
points by comparing the image motion flow and the true motion flow. 

15. (Original) The system of claim 14, wherein the image capturing device comprises a 
video camera. 

16. (Original) The system of claim 14, further comprising: 

means for tracking data of a plurality of instances of the one or more obstacle points over 
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a time interval; and 

means for determining that the one or more obstacle points is one or more actual 
obstacles based on the data. 

17. (Original) The system of claim 14, further comprising one or more onboard vehicle 
sensors for determining the ego-motion of the image capturing device. 

18. (Original) The system of claim 17, wherein the one or more onboard vehicle sensors 
comprises a gyro sensor. 

19. (Original) The system of claim 17, wherein the one or more onboard vehicle sensors 
comprises a GPS sensor. 

20. (Currently Amended) A machine readable medium having instructions stored thor e on 
for execution by a proc e ssor to perform computer readable medium encoded with computer 
executable instructions for performing a method for real-time obstacle detection from a vehicle 
moving relative to a road, comprising: 

calibrating an image capturing device, such that any image point can be mapped to a real- 
world point; 

receiving one or more images from the image capturing device; 
receiving information about the ego-motion of the image capturing device; 
selecting one or more real- world points according to a tractability criterion inversely 
proportional with an uncertainty associated with localization of the real-world points : 
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applying a motion estimation method on the one or more real-world points, the one or 
more images, and the road to determine an image motion flow of the one or more real-world 
points; 

determining a true motion flow of the one or more real-world points based on the one or 
more real world points, the one or more images, and the ego-motion; and 

determining that the one or more real-world points is one or more obstacle points by 
comparing the image motion flow and the true motion flow. 
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